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^300 
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-m ethod of making speech recognition enabled cell phone ^ 30 2 



-train an errorful training pron-guesser on weighted letter-to- 
phoneme mappings 



I 304 



-train set of blended acoustic phoneme models from the 
mapping of utterances of a set of acoustic training words 
against phonetic spellings of those words generated by 
the training pron-guesser 



i c 



306 



-generate list of common phonetically-mispelled names 



* 



^308 



-store in machine readable memory of the cellphone being 
made the following 

-data-310 

-blended acoustic phoneme models~332 

-list of common phonetically-mispelled names~334 

-a correct phonetic spelling for each of a plurality of 
commands~336 

-programming~312 

-cell phone control programming~344 

-speech recognition programming-342 

-errorful recognition pron-guessing programming 
which makes at least 50% of the same phonetic 
spelling errors on the training words as the training 
pron-guesser-340 



FIG. 3 



-Training pron-guesser-302 

-for each of a set of pron-guesser training words, obtaining -402 
-a textual spelling for the word~404 
-a phonetic spelling for the word-~406 
-frequency with which the word occurs~408 
-for each training word~410 

-map letters of word's textual spelling against phonemes of the phonetic 

spelling for the word~41 2 

-for each letter in the word~414 

-create an associated letter context that contains-416 
-the letter-418 

-the phoneme it is mapped to in the word-420 

-the context of letters, if any, that occur near the letter in the 

word-422 

-a frequency weight calculated as a function of the frequency of 
the word raised to a power less than one-424 

-bin together all occurrences of identical letter contexts from all the trainging 

words~426 

-for each set of identical letter contexts~428 

-create a summed frequency weight equal to the sum of all the frequency 

weights from all letter context in set-430 
-for each letter~432 

-call a pronGuesserDTreeTraining for the set of letter contexts created 

for the letter, with its summed frequency weight-434 

FIG. 4 
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-pronGuesserDTreeTraining-800 
-call processD-TreeNode with-802 

-currentNode equal to the d-tree's root node-804 
-currentContextSet equal to the set of contexts supplied to the d-tree's 
root-806 

FIG. 8 



-processDTreeNode (currentContextSet, currentNode)~900 
-for each possible context question~902 

-divide the current context set into two new context sets, one of contexts 
that satisfy the question and one of contexts that do not~904 
-for each of the two new context sets~906 

-calculate the entropy of the context set based on the distribution 
phonemes associated with the contexts of the set, weighting the 
contribution of each context's phoneme to the distribution as a 
function of the context's associated frequency based weight-900 
-if this total entropy for the two new context sets is the lowest calculated 
so far for the current node-908 

-save the entropy value as minEntropy-910 
-save the current context question as bestQuestion~912 
-save the two new context sets~914 
-if the difference between the entropy of the currentContextSet and 
minEntropy is not greater than a given amount~916 
-make the new node a terminal node~918 

-set the outputPhoneme for the terminal node equal to the phoneme 
associated with the largest number contexts in the node's context 
set-920 

-else-921 

-created a new node for each of the two new context sets-922 
-for each of two new nodes~924 

-if the number of contexts in the new node's context set is above a 
given number-926 

-call processDTreeNode with-928 

-currentNode equal to new node-930 
-currentContextSet equal to the new node's context set~932 
-else-~934 

-make the new node a terminal node-936 
-set the outputPhoneme for the terminal node equal to the 
phoneme associated with the largest number contexts in the 
node's context set-938 
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-pron-guessing programming*-^ 100 

-for each successive letter in the spelling of the word for which phonetic 
spelling is to be produced-1106 

-create a mapping context of the type used in training the pron-guesser's 

d-trees for the letter— 1 1 08 

-send the letter context through the d-tree corresponding to the given 
letter-1110 

-add the output phoneme associated with the end node of the d-tree into 
which the letter context is mapped to the phonetic spelling being created 
for the name~1112 
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Correct pronunciations: 
Cheryl sh eh r ax I 
Igor iy g ao r 
Jose hh ow z ey 
Philippe f ih I iy p 
Rene r ax n ey 

Incorrect guessed pronunciations: 

Cheryl ch eh r ax I (starts with "ch" sound instead of "sh") 

Igor iy g ax r (pronounced as "eaaer") 

Jose jh ow z ey (starts with T sound instead of "h") 

Philippe f ih I ih p (pronounced as "Philip") 

Rene r ax n (final "e" is dropped) 

FIG. 12 
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-training blended acoustic phoneme models-1600 

-for each of a plurality of acoustic training words~dd02 

-have errorful pron-guessing programming generate a phonetic spelling 
for word~dd04 

-create an untrained associate word model for the word, composed of a 
sequence of untrained acoustic phoneme models corresponding to the 
word's phonetic spelling~dd06 
-repeatedly~dd08 

-use HMM to map one or more utterances of each training word against 
the acoustic model for that word~dd10 

-alter each acoustic phoneme model to be more like the utterance 
sounds mapped against it in all training words in which it occurs~dd12 
-for each phoneme~dd14 

-for each node number n = 1 through 3-dd16 

-call acoustic node clustering d-tree algorithm for the nth node of 
the set of all triphone model for the given phoneme~dd18 
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-creating list of common phonetically-mispelled names-306 
-for each of a set of common names-2502 

-compare guessed phonetic spelling produced by recognition pron- 

guess^rs with known phonetic spellings for name-2504 

-if the guessed phonetic spelling is wrong, mark word as phonetically 

misspelled~2506 

-for each of a given number of the most common of the names marked as 
phonetically misspelled-2508 

-add to the list of common phonetically misspelled names-2510 
-the spelling of the name-2512 
-the correct phonetic spelling of the name-2514 

FIG. 25 
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Cellphone Programming 

2716 

-Contact Entry & Edit^ 
-Voice Dial^ 271 8 2720 
-Command Recognition^ 
-Command Subroutines 



^2704 



Contact Information 
-For Each Contact 
-Name ^ 2706 
-Address ^ 2708 
-Phone Numbers^ 2710 
-Email Addresses^ 271 2 
-Phonetic Spelling of Name - 



^342 
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List of Common Phonetically 
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-For Each Such Name 
-Name 
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-cell phone control programming-334 

-if user selects phone contact entry mode-2802 A 
-call name entry routine to enable user to enter name-2804 
-if user enters a spelling of a name-2806 

-create a blank phone contact record-2808 

-enter spelling of name in name field of record-2810 

-if spelling is one for which a correct phonetic spelling has 

been stored-2812 

-place correct phonetic spelling in phonetic spelling field of 

record-2814 
-else~2815 

-call pron-guesser for name~281 6 

-place phonetic spelling generated by pron-guesser in 

phonetic spelling field for record-2818 
-call phone number entry routine to enable user to enter 
phone number-2820 

-if user enters a phone number-2822 

-place entered phone number in phone number field of 
record-2824 j 



> 



2716 



-if user selects voice dial-2826 ^ 
-call the speech recognition programming with a vocabulary 
corresponding the names and corresponding phonetic spellings, 
whether guess or known correct, in the contact records and one or 
more command words and their known correct spellings-2828 
-if best match is a name in a contact record-2830 

-if there is a phone number stored in the contact record-2832 
-use text-to-speech synthesizer to generate sound of 
recognized name using its phonetic spelling~-2833 
-dial that number-2834 
-else if best match is a command-2836 

-call subroutine associated with the given command~2838 J 

-if in command recognition mode-2840 ^ 
-call the speech recognition programming with a vocabulary 
corresponding to the commands recognizable in the command 
mode-2842 ^ > 

-if best match is a given command-2844 

-call subroutine associated with the given command~2846 
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-speech recognition programming-342 
-if detect an utterance-2902 

-score the match between sounds of the utterance and the sequence of 
blended acoustic phoneme models corresponding with the phonetic 
spelling of each word in the vocabulary for which the recognition program 
has been called-2906 

-return with an indication of one or more words having the best score in 
the match-2908 

FIG. 29 
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-training pure acoustic phoneme models- 1600A 

-for each of a plurality of acoustic training words-1602 

-OBTAIN A CORRECT PHONETIC SPELLING FOR THE 
WORD-1604A 

-create an untrained associate word model for the word, composed of a 
sequence of untrained acoustic phoneme models corresponding to the 
word's phonetic spelling-^ 606 
-repeatedly-^ 608 

-use HMM to map one or more utterances of each training word against 
the acoustic model for that word-1610 

-alter each acoustic phoneme model to be more like the utterance 
sounds mapped against it in all training words in which it occurs-1612 

FIG. 31 



-training segregated blended models-3200 
-for each phoneme-3202 

-create an empty mapping list for the phoneme~3204 
-for each of a plurality of acoustic training words-3206 

-have pron-guesser guess phonetic spelling for the word-3208 

-map phonemes of guessed phonetic spelling for word against correct 

phonetic spelling for word-3210 

-for each guessed phoneme in guessed phonetic spelling~3212 
-find the sequence of one or more correct phonemes mapped 
against the guessed phoneme-3214 

-if the sequence mapped against the guessed phoneme does not 
already have an entry in the guessed phoneme's mapping list— 321 6 
-create an entry in that mapping list for the sequence of one or 
more correct phonemes and set its count to one~3218 
-else-3220 

-increment the count of the entry in the guessed phoneme's 
mapping list corresponding to the sequence of one or more 
correct phonemes-3222 
-for each phoneme-3224 

-normalize the count of its mapping list, so that the total of the count 
associated with all phonemes in the list equals one~3226 

FIG. 32 



-adapting pure acoustic models-3300 

-prompt user to say utterances of one or more adaptation training 
words-3302 

-map utterances of each adaptation training word against a sequence of pure 
acoustic phoneme models corresponding to a correct phonetic spelling of 
that word-3304 

-use the sounds mapped against each pure acoustic phoneme models to 

adapt that model-3306 

-for each given phoneme-3308 

-create an empty blended acoustic phoneme model for the given 

p/?oneA7?e-3310 

-for each phoneme listed in the given phoneme's mapping list having. a 
count above a certain value~33H 

•multiply the pure model of the listed phoneme by the listed 

phoneme's count in the mapping //sf~3314 

-add the resulting product to blended acoustic phoneme model for 

the given p/)oneme~3316 

FIG. 33 



•speech recognizing against segregated acoustic models~342A 
-if detect an utterance-2902 

-score the match between sounds of the utterance and the sequence of 
SEGREGATED blended acoustic phoneme models corresponding with 
the phonetic spelling of each word of the vocabulary for which the 
recognition program has been called~2906A 

-return with an indication of one or more words having the best score in 
the match-2908 

FIG. 34 



